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We investigate a transition between a two-dimensional topological insulator conduction state, 
characterized by a conductance (7 = 2 (in fundamental units e^ jh) and a Chern insulator with (7=1, 
induced by polarized magnetic impurities. Two kinds of coupling, ferro and antiferromagnetic, 
are considered with the electron and hole subbands. We demonstrate that for strong disorder, 
a phase (7=1 exists even for ferromagnetic order, in contrast with the prediction of the mean 
field approximation. This result is supported by direct numerical computations using Landauer 
transport formula, and by analytical calculations of the chemical potential and mass renormalization 
as a function of the disorder strength, in the self-consistent Born approximation. The transition is 
related to the suppression of one of the spin conduction channels, for strong enough disorder, by 
selective spin scattering and localization. 


PACS numbers: 73.50.-h, 73.63.-b, 85.70.-wi 

I. INTRODUCTION 

Two-dimensional topological insulators are a particular 
state of matter characterized by the coexistence of insu¬ 
lating bulk states and dissipationless conducting helical 
edge states.This results from the inversion of the va¬ 
lence and conduction bands together with a strong spin- 
orbit coupling: in helical states the spin and momentum 
of the carriers are intimately correlated. A typical mate¬ 
rial is HgTe, which, when confined in a quantum well, ex¬ 
hibits the quantum spin Hall effect.Under a potential 
bias, two edge states from the two Kramers pairs belong¬ 
ing to a Dirac cone, contribute to the electric current; the 
existence of a bulk gap ensures the quantization of the 
conductance to the value of (7 = 2 in units of as can 
be demonstrated using the Landauer-Biittiker formula.^ 
The quantization of the conductance is a physical phe¬ 
nomenon analogous to the anomalous quantum Hall ef¬ 
fect, but in a system invariant under time reversal.^’^ 
This quantization is related to the topology of the en¬ 
ergy bands; actually, the integer factor n in G = n[e^/h] 
is a Chern number characterizing the total flux of the 
Bloch wave function (a vector field) over the Brillouin 
zone (n = 2 for the helical edge states of a quantum spin 
Hall insulator).^ 

Topological insulators, in addition to exhibit a wealth 
of fundamental physical phenomena at the frontier of 
condensed matter and relativistic field theory,^ are a 
promising material for a variety of applications. In par¬ 
ticular, their property of coupling spin and momentum, 
is ideally suitable for applications in the domain of spin- 
tronics, whose goal is to control the spin degree of free¬ 
dom by pure electrical means. The conduction states of 
a topological insulator can be used in new concepts of 
electronic devices, ranging from spin transistors to fast, 
high density, memories.One may also imagine to 
exploit their ability to support different quantized con¬ 
duction regimes according to the number of protected 
edge states, for instance, when doped with magnetic im¬ 
purities. 


Indeed, as a function of the magnetic ordering, a topo¬ 
logical insulator doped with a transition metal can sup¬ 
port a quantum anomalous Hall state, phase similar to 
the quantum Hall state but without an external mag¬ 
netic field.Therefore, the system can, in principle, 
change from a (7 = 2 state in its topological time rever¬ 
sal symmetric phase (“Dirac” spin quantum Hall state), 
to a (7 = 1 state in an anomalous quantum Hall phase 
(Chern insulator), to eventually a normal insulating or 
metallic state. The observation of an anomalous quan¬ 
tum Hall state in a thin film of a topological insulator 
was recently realized experimentally.^^ 

In this paper, our objective is to demonstrate that a 
two-dimensional topological insulator doped with mag¬ 
netic impurities undergoes a disorder driven quantum 
phase transition between these topologically different 
states, when the disorder strength is varied. We start by 
studying a model of a HgTe quantum well, with uniformly 
distributed magnetic moments polarized perpendicularly 
to the plane. Numerical transport calculations were per¬ 
formed using the Landauer formula. We investigate the 
conductance in a two terminals setup, as a function of 
the disorder strength and the chemical potential. We fo¬ 
cused in particular on the behavior of the edge channels 
according to their spin. Finally, we calculate, in the sec¬ 
ond order self-consistent Born approximation, the real 
part of the self-energy to obtain explicit expressions of 
the renormalized mass and the chemical potential. 


II. MODEL 

A simple model of a two-dimensional topological insu¬ 
lator is given by a four band Hamiltonian of the form (in 
momentum space),^ 

. ( 1 ) 
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where 

= —(sm(akx)Tx -h sin(aky)Ty) ^ rriTz 
2 

- -^{Dtq + Brz)[2 - cos{akx) - cos{aky)] , (2) 

and hi{k) = h^{—ky in the (spin(8)band)= a r base, 
T = {Tx^Ty^Tz) and cr = {(Tx^cFy^cFz) are Pauli matrices 
in band and spin spaces (with identity matrices, 

and the Kronecker product is denoted by a pair as in 
^ = {kx^ky), k = \k\ is the wavenumber, a the 
lattice step, and A, m, 5, D are material parameters. In 
the following we adopt units such that a = A = h = 
1. In such a system, typical values are m = —0.137, 
B = —0.376 and D = —0.281, as computed with a = 
5nm and A = 364nmmeV, which are standard tight- 
binding parameters of HgTe thin films (the unit of energy 
is So = 73meV).^^ The form of the Hamiltonian insures 
invariance with respect to time reversal and an inversed 
band structure when m < 0 (jnB > 0). 

In order to take into account the disorder, we add an 
exchange term J/ coupling to the impurity’s normalized 
magnetic moment iS'^, 5'^ = 1, at lattice site i (in position 
representation): 

Va = Jl'^ cj {Si ■ (7 Ta)Ci ( 3 ) 

iei 

where q = (q+^, is the annihilation op¬ 

erator at position Xi of “electrons” (-h) and “holes” (—) 
with spin components up (t) and down (^). The sum is 
over the set of Nj impurity sites / uniformly distributed 
in the lattice; we denote ni = Nj/N their concentra¬ 
tion (A^ is the number of lattice sites). The parameter 
a = 0 , 2 ;, determines the type of magnetic coupling with 
the band states: for a = z the spin splitting is of op¬ 
posite sign for electrons and holes, we shall refer to this 
case as “antiferromagnetic,” and for a = 0, both quasi¬ 
particles have the same Zeeman splitting, this case shall 
be referred as “ferromagnetic.”^^ The impurity magnetic 
moment is randomly oriented inside a cone of angle Oq 
around the z-axis: 

{S) = (0,0, MO , {SO = I - 1) + 1] , 

where Mz = cos^(^o/2) is the mean magnetization, and 
we have taken into account that Si is modulus one. Im¬ 
posing a magnetic order breaks the time reversal sym¬ 
metry, modifying the electronic properties of the edge 
states. In a mean field approximation, in the ferromag¬ 
netic case, the tq term splits the edge states but do not 
open a gap, while in the antiferromagnetic case the term 
in Tz opens in addition a gap (for one of the two spin po¬ 
larizations). One may infer that the former case is trivial 
and the later one transform the topological insulator into 
a Chern insulator.This picture can be deeply modified 
by spin dependent backscattering and by localization ef¬ 
fects due to disorder. 


III. RESULTS 

Indeed, our numerical computations of the tight- 
binding model (1-3), demonstrate that in both cases, 
there is a transition from Dirac to Chern states. 

We computed the conductance as a function of the 
Fermi energy Ep and the disorder strength Jj from 
the Landauer-Biittiker formula using nonequilibrium 
Keldysh Green functions and a recursive method, 

The conductance G, is computed in the linear response 
approximation, from the retarded and advanced 
Green functions, 

2 poo ^ p 

G=j J_^dE-^{Tr[rnG^{E)rLG^{E)]}, 

where / = f{E) is the Fermi-Dirac distribution, 
are the broadenings due to the left (L) and right {R) 
leads, the trace is taken over the band and spin indices, 
and the angle brackets are for the disorder averaging. 
Our code allows also the computation of local quanti¬ 
ties, such as the density of quasiparticles, the density 
of states and the currents. Specifically, we calculated 
the transport through a disordered central region, con¬ 
nected to clean topological insulator leads. The lattice 
size is 72 + 256 + 72 x 64, and the physical quantities 
were averaged over a set of different impurities distri¬ 
butions. To minimize the effects of discontinuities, an 
intermediate clean region was inserted between the semi 
infinite leads and the doped region. We explored a range 
of Fermi energies around the gap of the clean system, 
and exchange coupling strengths up to the strong disor¬ 
der regime (Fig. 1). 

If one replaces the random potential (3) by its mean 
value (proportional to the polarization Mz), the resulting 
Hamiltonian can be readily diagonalized, and the mod¬ 
ification of the energy bands predicted. When the cou¬ 
pling of electrons and holes are of different signs (subband 
antiferromagnetic coupling), the spin up band develops 
a gap at a critical value of the disorder (in our case, 
JinjMz = 0.137 = —m). In the other case (subband fer¬ 
romagnetic coupling), bands of opposite spin cross with¬ 
out opening a gap. Therefore, the mean field approxi¬ 
mation predicts the disappearance of one spin channel in 
the antiferromagnetic case, and a simple transition to a 
normal state in the ferromagnetic case. In both cases, the 
topological insulator bulk gap vanishes linearly with the 
noise strength (the chemical potential is a linear function 
of J/). 

The numerical computations represented in Fig 1, 
qualitatively confirm this scenario. We show the conduc¬ 
tance in the parameter range corresponding to the bulk 
gap {\Ef\ < \m\ = 0.137) of the clean system, from weak 
to strong disorder, and for the two kinds of magnetic 
coupling. In particular, the antiferromagnetic case (left 
panel), shows regions in the {Jj^Ep) plane, with G = 2 
(dark blue), and G = 1 (light blue), corresponding to 
transport with two active channels (topological insulator 
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FIG. 1. Conductance phase diagram in the Fermi energy Ep, disorder strength Jj parameter space, for the antiferromagnetic 
(left) and ferromagnetic (right) subband couplings. The topological insulator phase, for Ep ~ 0 in the bulk gap {\Ep\ < \m\ = 
0.137), is characterized by G = 2 (in dark blue) at weak disorder; a Chern insulator state G = 1 (in light blue) appears at 
stronger noise intensity in both cases. The polarization of impurities is Mz = 1, and their concentration is ni = 0.4 for the 
antiferromagnetic case, and m = 0.2 for the ferromagneitic case. 


state) and one active channel (Chern insulator state), 
respectively. However, in the ferromagnetic case (right 
panel), a region with G = 1 is observed, in contradiction 
with the mean field prediction. (Note that the relevant 
states for the quantized conductance are in the bulk gap, 
which may disappear for strong polarized disorder.) 

The phase diagram of the antiferromagnetic case shows 
an anomalous quantum Hall state for disorder strengths 
in the range Jj ~ 0.3... 0.4; the mean field prediction is 
Ji ^ 0.35 (we used nj = 0.4 and Mz = !)• It is interest¬ 
ing to observe that for a fixed value of Jj , it is possible to 
change the conduction state from G = 2 to G = 1 by in¬ 
creasing the Fermi energy. In the ferromagnetic case the 
extension of the G = 2 phase is similarly well described 
by the mean field approximation (with nj = 0.2 and 
Mz = 1 the mean field closing gap value is J/ ~ 0.7). A 
large G = 1 region appears at strong disorder and mostly 
negative Fermi energies. The extension and even the exis¬ 
tence of these quantized conductance states are obviously 
dependent on the underlying symmetries of the system. 
Decreasing the polarization of the impurities {Mz < 1), 
that is allowing in-plane fluctuations of their magnetic 
moments, breaks the spin orientation conservation (the 
Hamiltonian no longer commutes with the vertical com¬ 
ponent of the spin), and backscattering and spin flipping 
of the edge states shrinks the topological insulator phase. 
Simulations for various polarization states (not shown), 
suggest that the Chern insulator phase is more robust 
in the case of ferromagnetic subband coupling than in 
the antiferromagnetic case. As a matter of fact, the re¬ 
sponse of the system to the random perturbations pro¬ 
duced by the spatial inhomogeneities in the distribution 
of impurities, is qualitatively different in the two cases. 


The Chern insulator phase for ferromagnetic coupling, 
being an effect of strong disorder, is naturally insensitive 
to these fluctuations. In the antiferromagnetic case, we 
note important fluctuations of the conductivity in the re¬ 
gion around the G = 1 phase. As a result, the G = 1 
region itself slightly moves in the (Jj^Ep) space for each 
noise distribution. Therefore, the effect of averaging is to 
blur the contours of the Chern phase region, reducing its 
extension. We verified that fluctuations are completely 
suppressed in both G = 2 and G = 1 phases. 

For fully polarized impurities, the microscopic mech¬ 
anism of the transitions between different conductance 
regimes, can be investigated by computing the bond cur¬ 
rent field, 

_ 2 p (jfp 

lij =—J - t^iG<{E,i,j)], 

where lij is the current between neighboring sites (i, j), 
G^ is the lesser Green function, it is a matrix in band 
and spin indices, and tij are the jump matrices, and the 
nonequilibrium spin density, 

/ p-\-eV irp 

where V is the external bias voltage. The local currents 
and the spin up density excess 

^ Ant 
^ Ant + ^^4- ' 

are represented in Fig. 2 (arrows field and background 
gray levels, respectively). 
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FIG. 2. Local currents in various conduction states for the antiferromagnetic (left) and ferromagnetic (right) cases: G — 2 
(top), G = 1 (middle) and G <C 1 (bottom). The Chern insulating state G = 1, exhibits the persistence of spin down edge 
state. The background color represents the spin-up nonequilibrium density excess from full spin-up polarization in white, 
to full spin-down polarization in black. 


The dependence on the relative orientation of the car¬ 
riers spin and impurities magnetic moment, leads to a 
rich variety of interactions affecting differently the edge 
states according to their polarization. In particular, the 
effect of magnetic disorder is to selectively localize bulk 
states depending on their spin. Comparing the paths of 
the carriers through the scattering off impurities region 
between the antiferromagnetic (left) and ferromagnetic 
(right) subband coupling cases, we observe that their are 
qualitatively similar (we used the same numerical param¬ 
eters in Figs 1 and 2). The main difference is in the width 
of the edge channels, especially in the bulk region. In the 
topological insulator phase (top row) both spin-up top 
channel and spin-down bottom channel pass through the 
disordered region; in the antiferromagnetic case the top 
channel deeply penetrates in the bulk. In the Chern insu¬ 
lator phase (middle row) the suppression of the spin-up 
component is much stronger in the ferromagnetic case. 
The non-quantized conductance state is shown in the 
bottom row. The strong scattering allows the connex¬ 
ion between the two edges, leading to a situation where 
one of the two spins polarizations is completely filtered 
out; an accumulation of the other spin polarization can 
therefore appear on the opposite lead side. The system 
acts as a spin selection filter in the two cases shown in 
Fig. 2, G = 1 for ferromagnetic symmetry (middle row, 
left) and G < 1 for the antiferromagnetic symmetry (bot¬ 
tom, right). 

These results suggest that the setting up of the anoma¬ 
lous quantum Hall state for antiferromagnetic and ferro¬ 
magnetic couplings are not due to the same microscopic 
mechanism. In the antiferromagnetic case it is a conse¬ 
quence of the opening of a band gap for one spin species. 
The ferromagnetic case is at variance, an effect of the dis¬ 


order and the establishment of a spin dependent mobility 
gap. The emergence of localized states can be uncovered 
by the measure of the local density of states, 

i) = ^(n|ct4{i)^ct4{i)|n)(5(£’ - e„) 

n 

=-Im i) 

where |n) and Sn are eigenstates and eigenvalues of iL, 
and G^{E, i, i) the retarded Green function computed at 
site i. In Fig. 3 we show i) in a logarithmic scale, 

for the same parameters (energy and disorder strength) 
used in Fig. 2: antiferromagnetic (left) and ferromag¬ 
netic (right) cases, for three values of the conductance, 
G = 2 (top), G = 1 (middle), and G < 1 (bottom). 
Each panel includes the spin-up (p^, top) and spin-down 
(p^, bottom) components. The presence of open chan¬ 
nels are visible in each case: two spins in the G = 2 
conduction regime, and one spin in G = 1 and nor¬ 
mal conduction regimes. The main physical difference 
between the two coupling modes, antiferromagnetic and 
ferromagnetic, appears in the G = 1 anomalous quan¬ 
tum Hall state. In the antiferromagnetic case, there are 
energy states available for the two spins polarizations. 
This is in contrast with the complete absence of avail¬ 
able spin-up states in the ferromagnetic case. Therefore, 
we have evidence showing that the mechanism allow¬ 
ing the anomalous quantum Hall effect for ferromagnetic 
coupling, do not need a bulk gap but rather a mobil¬ 
ity gap and the selective localization of one spin polar¬ 
ization states (in analogy with the topological Anderson 
insulators^^). For the antiferromagnetic case, localiza¬ 
tion appears at stronger disorder (see bottom row, left of 
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Fig. 2). 


IV. DISCUSSION AND CONCLUSIONS 

An analytical computation of the renormalized Fermi 
energy and mass as a function of the disorder strength, 
in the self-consistent Born approximation, allows us to 
get some insight into the effects of the magnetic impuri¬ 
ties on the transport properties and to confirm the qual¬ 
itative behavior depicted by the numerical simulations. 
We are specifically interested in the dependence of these 
renormalized quantities on the spin of the current carri¬ 
ers and their coupling with the spatially distributed mag¬ 
netic moments. We follow a method used to study the 
transition of an insulator to a topological insulator, trig¬ 
gered by Anderson localization. 


A. Born approximation 

The thin film Hamiltonian becomes, in the small 
wavenumber approximation, 

H = J2ci[Ho{k) - + ^cty„(fc)cfe+q , (4) 

k k,q 

where we added a chemical potential term /i to the un¬ 
perturbed Hamiltonian Hq. The diagonal blocks of Ho, 
of Eq. (1), are now given by: 

h^{k) = —Dk^To + (m — Bk‘^)Tz k • r 
hi{k) = —Dk^To + (m — Bk^)Tz — k • r* , (5) 

and the random potential is, in Fourier space, 

ya(fe) = (6) 

iei 

We are interested in the renormalization of the mass m 
and the chemical potential {i, which depend on the real 
part of the self-energy and eventually in their 

splitting depending on spin. It is convenient to take into 
account the mean value of the random potential {V) in 
the free Green function (the angle brackets stand for the 
Si and Xi probability distribution integration), 

g„{E,k) = [E + ^-Ho{k)-iy„)]-\ (7) 

where (I 4 ) = ( 14 ( 0 )), 

{Va) = niJjMzazTa 

and a suitable continuation to complex energy E is as¬ 
sumed. The explicit form of the mean field Green func¬ 
tion can be written as. 


f9i-{E,k) 0 \ 

V 0 9i{E,k)) 


(8) 


where 

= T [(£; + + Dk^)TQ + (m^ - Bk^)Tz + k ■ t] 

(9) 

54 = [i^ + M 4 . + -Dfc^)ro + (m^ - Bk'^)Tz - k ■ t*] 

^ (10) 

where we defined spin dependent chemical potential 
and mass as, 

= = + = m^ = m ( 11 ) 

with V = niJiMz, for the ferromagnetic case (note that 
the noise term v enters through the chemical potential), 
and 


= /i , = mEv , mi = m — v (12) 

for the antiferromagnetic case (here the random poten¬ 
tial adds to the mass term); the determinants = 

A-f, 4 .(£', k), are given by, 

= {E + - k'^f - (mt4 - Bk'^f - k'^ 

(note that they only depend on the wavenumber modu¬ 
lus). 

The random averaged Green function is defined in 
terms of the self-energy, 

G{E, k) = {{E - H)-l = [g-\E, k) - ^{E)]-^ . (13) 

where the self-energy E(E), is computed from a pertur¬ 
bation series in powers of the random potential (the de¬ 
pendence on the kind of magnetic order is taken in the 
form of the parameters (11) and (12)). It depends only 
on the energy: after averaging over the impurities pos¬ 
tions and magnetic moments orientations (isotropic in 
the plane), one should recover translation invariance. To 
second order, 

E{E) = J2{AV{q-k)g{q)AV{k-q)) (14) 

Q 

where AV = V—{V). Only diagonal terms survive to the 
disorder averaging and integration over the polar angle of 
the internal wavevector. Transforming the sum into an 
integral, and performing the matrix multiplication and 
noise averaging, one gets, 

T,{E)=niJjJ^ ^[vzgz{E,q)+v_igj_{E,q)] (15) 

where we introduced a lattice cutoff k^ = ir (at the bor¬ 
der of the Brillouin zone), and we defined the diagonal 
matrices. 


gz = diag 


E -|- gi Ek^ 


To 


mi 


-Bk‘^ 


A^ 

E T gi T Ek^ 


To 


Ai 

mi — Bk‘^ 
Ai ' 


g{E,k) = 


(16) 
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Ejr =-0.02, Jj -0.33, G-2 Ep --0.00, Jj -0.2, 



0 _ 72_328_400 0 _ 72_328_400 


10'^ 10'^ 10^ lO’^ 10^ 10'^ 10'^ 10^ 10*^ 10^ 

FIG. 3. Local density of states associated to the local currents of Fig. 2. Antiferromagnetic (left column) and ferromagnetic 
(right column) cases. For each transport regime, G = 2, G = 1 and G < 1 top, middle and bottom rows, respectively, the 
spin-up (top) and spin-down (bottom) components are presented. 


and 


obtains, 


9l. — 


(17) 


the same matrix as Qz with the spin sectors exchanged, 
and 


t;, = (Si) - n]Ml = (1 - nf)M| + 1(1 - M,f , 

v^ = l-{Sl)=‘^{l-M,){l + 2M,), (18) 

in the fully polarized case Mz = 1, only the first term 
in Vz remains; the fluctuation effects are maximized for 
a impurity concentration nj = 1/v^. In fact, the q in¬ 
tegral in (15) is, in the continuous limit, logarithmically 
divergent; hence, keeping only the dominant terms con¬ 
tributing to the real part near the Fermi energy one 


Re = 


njJj Btz - Dtq 


Vz log 




Vp log 


A^;(F^f,0) 

{B^-D^)kt 


A;^(F^f,0) 


(19) 


where the dependence on the impurities polarization is 
through the parameters and present in the de¬ 
terminants A. The term proportional to tq renormal¬ 
izes the Fermi level (/i) and the one in renormalizes 
the gap (m). We observe that longitudinal {vz)^ and 
transverse {v±)^ fluctuations introduce corrections of the 
gap and energy levels that depend on spin; in particular, 
transverse fluctuations couple the two spin polarizations, 
through which flipping of the spin by scattering becomes 
possible. 

This renormalization also has an impact on the be¬ 
havior of the spin dependent edge states. A simple 
computation^^ leads to the following conditions for the 
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existence of edge states, 


the renormalized parameters are: 


B 



niJj 

87r(B2 _ D) 
+ V± log 


D^)kt 


Vz log . _ . 2 

{Ef T vY 

(B‘^ - D^)kt 




{Ep zb v)‘^ — m? 


> 0 ( 20 ) 


{v = riiJiMz, the upper and lower signs correspond to 
spin up and spin down, respectively) for the ferromag¬ 
netic case, and 


B 


mEv 


niJj 


Vz log 


D^)kt 


El 


B 87r(B2 - Z)2) 

(B2 D^)kf 


v± log 


- {m^ vY 


(m ± vY 
> 0 ( 21 ) 


for the antiferromagnetic case. In the ferromagnetic case 
the main effect is a decrease of the characteristic pene¬ 
tration length and opposite shifts of the Fermi energy de¬ 
pending on spin. In the antiferromagnetic case, the char¬ 
acteristic length of the spin down state tends to increase, 
making this channel penetrate into the bulk material. 

This effect may be considered as the onset of the G = 2 
to G = 1 transition. 

In principle, the logarithmic term in (19) can change 
sign for strong enough disorder, typically when v B^ 
inducing a qualitative change in the topological proper¬ 
ties of the insulator. Although this regime is somewhat 
outside the validity of the perturbation expansion, it in¬ 
dicates that the effect of fluctuations can be nontrivial, 
as in the topological insulator transition driven by An¬ 
derson localization.^^ 


B. Phase diagram 

The perturbation expansion, even within the mean 
field approximation that accounts for the spin splitting, 
cannot be extended to finite disorder. Moreover, non¬ 
dominant terms neglected in the calculation of the inte¬ 
gral in (15), possess symmetry properties different from 
the kept ones, and their contribution can become sig¬ 
nificant at finite disorder. It is therefore convenient to 
compute the self-energy using instead the self-consistent 
approximation by replacing g in (14) by the full aver¬ 
aged Green function (13); this allows a resummation of 
all noncrossing diagrams and extend the range of valid¬ 
ity of the renormalization of the bare parameters as a 
function of the disorder. 

The numerical resolution of the implicit equation for S 
gives the renormalized values of the up and down masses 
and chemical potentials (barred quantities): 

ReS = -diag[(m^ - m^)Tz + (yht “ 

(% - mY)Tz - {]li - I^Yto] ( 22 ) 

as a function of the Fermi energy Ep and disorder 
strenght J/. Explicitly, the self-consistent equations for 




1^1 J I 




kx Ey 


-^{Ep + /it + 


V± 


+ -^{Ef + ^^4- + Ek) 


(23) 




njJj 

N2 


E 

kx Ey 


— (Ei? + /it + Dk) 


v± 


+ -^{Ep -b /it + Dk) 
At 


(24) 


and 


mt = mt 


mi = mi 


^kk 


TllJj 

^kk 


^(mt - Bk) + Bk) 

(25) 

^(mi - Bk) + ^(mt - Bk) 

(26) 


where Bk = 5(4 — 2cosA:a^ — 2 cosky), Dk = 5(4 — 
2 cos kx — 2 cos ky), and 

At = {Ep + /it + Dk)‘^ - {fhi - Bk)‘^ - sin^ kx - sin^ ky 

and a similar expression for the spin down determinant 
At- We note that fluctuations introduce a coupling be¬ 
tween spin up and spin down parameters that vanish in 
the full polarized case (i;_L = 0). Indeed, as already 
present in Eqs. 19 of the perturbation series, in-plane 
fluctuations (proportional to v±), break a^-spin conser¬ 
vation, and couple spin orientations through scattering 
off the impurities. 

We represented in Eig. 4, the gap edges gn = Emu, 
for the antiferromagnetic (left) and ferromagnetic (right) 
cases, of the electron (E^, E|) and hole (Ht, H|) bands, 
together with the band inversion thresholds for the spin 
up {mi = 0) and down {mi = 0) subbands, and the spin 
dependent chemical potentials (/i^,/i|). 

In the antiferromagnetic case, the crossing of Ht and 
Et, coinciding with the = 0 threshold, points out 
the opening of a gap, and the restoring of a topologically 
trivial state of the spin up subband. The G = 2 and G = 
1 regions should locate on the left and right of the = 0 
vertical line, respectively (as schematically represented 
by the blue shaded region, around the gi line). 

In the ferromagnetic case, a remarkable effect arises: 
the bending towards positive energies of both Et and 
E^- subbands. Due to this bending the electron bands 
can cross the corresponding hole bands with the same 
spin. The line intersects the Ht and Et crossing, as 
in the antiferromagnetic case, and a G = 1 region can 
develop on its higher disorder strength side. This region 
is delimited by the crossing of the spin down subbands 
and the mi = 0 line. 
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■AF', nj=OA, M^=1.0 


■F', nj=OX M^=1.0 




disorder Jj (eo) disorder Jj (eo) 


FIG. 4. Phase diagram computed from the self-consistent Born approxiamtion. Antiferromagnetic (left) and ferromagnetic 
(right) full polarized cases. The blue shaded region corresponds schematically to the G — 1 phase. Solid lines stand for spin 
up bands, dashed lines for spin down bands; dotted lines separate the topological phase (on their left side) to the trivial ones 
(towards strong disorder); dot-dashed lines are for the chemical potential levels. 


These results suggest that, although the mechanisms 
are different, the effective band structure leading to the 
anomalous quantum Hall state is essentially the same for 
the two coupling modes (equal or opposite spin splitting 
sign of the electron and hole subbands). In the ferromag¬ 
netic case, it is a strong disorder effect. 


C. Conclusion 

The main result of the present study is that a magnet¬ 
ically doped two-dimensional topological insulator sup¬ 
ports different quantized transport regimes as a function 
of the disorder strength. The transition between a topo¬ 
logical insulator phase, characterized by the presence of 
two spin polarized channels, to a Chern insulator phase, 
with one spin conduction channel, is related to the se¬ 
lective suppression of one of the spin states. In particu¬ 
lar, we observed the emergence of this anomalous quan¬ 
tum Hall state, in the case of equal sign coupling of the 
electron and hole subbands with the magnetic impurities 
(ferromagnetic case). This is a disorder driven effect that 
situates beyond the range of validity of the mean field ap¬ 
proximation. The complete neglect of fluctuations, leads 
to a simple renormalization of the chemical potential. 


without incidence on the mass gap. At variance, in the 
antiferromagnetic case (opposite signs couplings for elec¬ 
trons and holes), this approximation is enough to explain 
the opening of a gap for one spin band. 

More generally, the effect of disorder manifests by 
a renormalization of the mass and chemical potentials, 
which become spin dependent due to the fluctuations 
contributions. In the ferromagnetic case, strong disorder 
causes a bending of the bands that allows a nontrivial 
crossing. As revealed by the local density of states and 
the behavior of the local currents, the appearance in this 
case of the Chern insulator state, is related to the local¬ 
ization of one of the spin bands. As a consequence, the 
device behaves as a spin filter, with accumulation of the 
allowed spin conduction band on the opposite lead. 
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